Papers with hierarchical multi-agent system
HiMATE: A Hierarchical Multi-Agent Framework for Machine Translation Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LLM-based evaluation methods fail to accurately identify error spans and assess their severity. |
| Approach: | They propose a Hierarchical Multi-Agent Framework for Machine Translation Evaluation based on the MQM error typology and a hierarchical multi-agent system enabling granular evaluation of subtype errors. |
| Outcome: | The proposed framework outperforms baselines in error span detection and severity assessment. |
SciFlow-Bench: Evaluating Structure-Aware Scientific Diagram Generation via Inverse Parsing (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for scientific diagram generation rely on image-centric metrics or evaluation of intermediate symbolic representations rather than final rendered images. |
| Approach: | They propose a structure-first benchmark for evaluating scientific diagram generation from pixel-level outputs. |
| Outcome: | The proposed benchmark evaluates scientific diagram generation directly from pixel-level outputs. |